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.^ ' Abstract 

]>^. The study of biological cells as a nonequilibrium, nonlinear, stochastic open chemical 

systems provides a paradigm for other complex, self-organizing systems with short-time de- 
terministic and long-time evolutionary dynamics. 



^t 1 Introduction 

t> 

00 . 

£T) , Post-genomic biology can only be fully understood from a combining cellular-molecular and evo- 

(T) \ lutionary perspective. This is an integration of extremely small and extremely large scale dynam- 

ics, in space and time, with significant heterogeneity in the system. It is arguable that this is a 
challenge any open-system has to confront: Environmental influence on the system at a large scale 
is felt, to a significant degree, by most of the small components inside the system. Interestingly, 
the fundamental issues in both cellular and evolutionary dynamics are now firmed cast in terms of 
stochastic mathematics. While the field of stochastic dynamics has more than 100 years of his- 
tory, starting with Einstein's 1905 study of Brownian motion and Langevin's 1908 proposal of a 
stochastic differential equation, we still know very little about it beyond the existence proofs and 
formal constructions. Applied stochastic dynamics, as a mathematical tool, is in a rather primitive 
state compared to our deeper understanding of the deterministic dynamics that is at the foundation 
of 300 years of Newton-Laplace's world view. An applied stochastic dynamic theory with in-depth 
understanding of the interaction between deterministic (i.e., bias) and stochastic (i.e., random) ele- 
ments is urgently needed for the progress of biology, and the understanding of other open systems. 
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In other words, we are particularly interested in how the stochastic random motion is "coupled" to 
deterministic, often nonlinear, dynamics. When one observes an noisy oscillation, is it a limit cycle 
with some noise, or a rotational random walk? This lead us to being interested in the concept of 
entropy in stochastic dynamics. We were able to shown that the entire statistical thermodynamic 
structure, with the core concepts like entropy and free energy and the Second Law, is in fact a 
mathematical one — the molecular thermal physics turns out to be one example. One can equally 
develop a "themo"-dynamic theory for stochastic cellular processes, for evolutionary dynamics, 
and for dynamics of other open-systems. 

In this document, I shall first give a brief introduction to the current status of the open-chemical 
system theory. Then I shall discuss a few topics which I believe deserve further development. 

2 What is the Open Chemical Systems Theory? 

One can leave a chemical reaction system alone, and see what happens: It goes through a transient 
process with the concentrations of the chemicals changing with time, known as relaxation kinetics. 
Eventually, it settles in a chemical equilibrium. If the system is sufficiently small, then one can 
even observe the concentrations continuously fluctuate with time, but all their statistics are time 
invariant Q~l|2]. We call this state equilibrium steady state. 

A living cell as a biochemical system, to a first order approximation, is in a steady state, known 
as homeostasis J3]|. But it is not in an equilibrium: One has to continuously change the medium in 
which a cell situates. The medium has to contain "high calorie" chemicals as food to a cell which 
returns its "waste product" to the medium. So how to rigorously define such a chemical state of a 
system which is open to exchange with its surrounding [|4]|? This is the motivation for developing 
the open chemical system theory fl51|6l|71. Such a system is called a nonequilibrium steady state 
(NESS); it is an example of the self-organizing dissipative structures [8]. With the stochastic 
dynamic perspective, one immediately realizes that deterministic periodic chemical oscillation is 
an NESS [H! 

Chemical fluxes are continuously going through such systems. And because of the presence of 
nonlinear chemical reactions, these fluxes are coupled to internal (bio)chemical reactions. There- 
fore, according to Kirchhoff 's law there will be cycle fluxes in an NESS IfTOll . A deep mathematical 
theorem shows that, in a large class of stochastic systems, a cycle flux exists if and only if the rate 
of entropy production is positive [1 1 j. In fact, when some of the cycle fluxes are sufficiently strong, 
a macroscopic oscillation emerge [[T2l . 

The existence of the cycle flux turns out to be a fundamental property of open chemical sys- 
tems. It is intimately related to the breakdown of the detailed balance. It is mathematically related 
to non-self-adjoint operators. The presence of cycle flux also indicates that the stationary proba- 
bility distribution in one part of the system can be influenced by another part far away, thus the 
dynamics is nonlocal [This is not possible for a system with detailed balance which yields Boltz- 
mann's Law.] Even more important: a strong flux is associated with a more "deterministic kind of" 
motion (breaking a symmetry). Hence, a strongly driven chemical system can exhibit very regular 
dynamics. Energy can suppress fluctuations in small open chemical systems, making them behave 
like a little machine. 



In the past several years, we have shown that almost every biochemically important cellular 
function is intimately related to the open chemical system setting, and correlated with the energy 
expenditure associated with the system. This include kinetic proofreading |fT3l[T4llT5l , cellular sig- 
nal switch [16], and fidelity in DNA replication [T7|. Another significant insight is the emergence 
of chemical bistability. In stochastic dynamic term, this is characterized by stationary probabil- 
ity (density) function exhibiting multiple peaks. We say there are multiple stochastic attractors. 
These attractors are emergent properties of the system dynamics. Often but not always, they are 
the stochastic counterparts of the deterministic stable attractors [18|. These attractors defines an 
emergent, discrete multi-state stochastic dynamics on an entirely different time scale: A cellular 
evolution time scale emerge. Therefore, the open chemical system model is able to conceptually 
bridge the detailed biochemical reactions to the emergent cellular dynamics that reflects differenti- 
ation, apoptosis, and epigenetics |[T9l ! Furthermore, it can be shown that there is also an emergent 
"landscape" [20], akin to the adaptive landscape in evolution theory. But this landscape is nonlocal, 
itself is an emergent property, and its predictive power is, in some sense, only retrospective. 

3 Nonequilibrium Steady-State, Emergent Landscape and Flux 
Field in Open Systems 

The concept of nonequilibrium steady state, also known as nonequilibrium stationary state, is one 
of the central concepts in studies of open systems. It deserves focused and in-depth investigations. 
Note that for a large class of stochastic dynamics, there is a unique, asymptotically attractive sta- 
tionary process (invariant measure): The system is always self-organizing. In statistical physics 
and related mathematical theory of interacting particle systems, related research has been pursued 
for many years. However, in the past, the emphases have been on the system's infinite size limit 
but assuming significant "homogeneity". What has not been widely studied is stochastic processes 
with NESS. The technical difficulties are mainly in the nonsymmetric nature of the process, which 
made even the mathematical existence proof impossible. The recent exciting development of fluc- 
tuation theorem is precisely along this line [21 J. It is an important first step. Interestingly, this 
result is large unknown to mathematicians working in the stochastic processes [|22l . 

Using stochastic differential equation with small noise (e) as a model system, it will be im- 
portant to further explore the connection between the NESS invariant density / e ss (x) and its e- 
dependence, and its Lyapunov property in the corresponding deterministic dynamics. Note that 
while the support of f° s (x) is highly singular with Dirac measure in the limit of e tending zero, the 
quantity 

lime log f* s (x) 

often is better behaved with full support in the space. This line of research is intimately related to 
the deep theory developed by Freidlin and Wentzell [231. This theory needed to be simplified and 
delivered to the hands of broader applied mathematicians and scientists. 

One should not forget, however, that the landscape [|20l , and the stationary distribution, is only 
half of the characterization of the system. The NESS is also characterized by its flux field J which 
is divergent free V • J = 0. Our understanding of this aspect of stochastic dynamics is still missing 



Il24ll . In fact, a cogent stochastic interpretation of the J is still elusive. Nevertheless, the J gives 
the "dynamical information" of an open system in its NESS. 

There seems to be a deep connection between this line of inquiry and the theory of Hodge 
decomposition, and algebraic topology [25] . 



4 The Thermodynamic Structure of Stochastic Dynamical Sys- 
tems 

Historically, thermodynamics has been one of the most important organizational principles for 
systems with large number of atoms and molecules, systems considered to be complex mainly due 
to its large number of components. When a system has a large number of components, especially 
when all the components are not homogeneous, the interactions between components can only be 
characterized in a statistical sense. In fact, only statistical characterization is meaningful. We now 
realize that the thermodynamics is not just a physical theory about atoms and molecules. Rather, 
any stochastic system characterized in terms of Markov dynamics possesses a "thermo"dynamic 
structure. Since this theory has nothing to do with the temperature per se, we put the "thermo" 
in the quotation marks [28] . In an essence, one has resolved what Gian-Carlo Rota considered 
"a standing between physicists and mathematicians that thermodynamics cannot be axiomatized" 

EH. 

There are two inter-related threads in this general theory: One centers around relative entropy, 
which is intimately related to the free energy in Gibbs' statistical mechanics F Il2~6l l27l . An 
important fact about F is dF/dt = —fd{t) < 0. Another thread centered around Gibbs-Shannon 
entropy S, which satisfies a conservation law dS/dt = e p (t) — hd(t). An important fact here is 
e p (t) > 0. f d , e p , and h d are called free energy dissipation rate, entropy production rate, and heat 
dissipation rate. 

For Markov systems with detailed balance which correspond to closed systems: f d {t) = e p {t). 
Furthermore, in the long time limit, fd = e p = hd = 0. This is an equilibrium steady state (with 
fluctuations). 

For Markov systems without detailed balance, which correspond to open systems: e p (t) = 
fd{t) + Qhk{t) where Qhk(t) > also. Qhk, called house-keeping heat, characterizes the amount 
of energy expenditure (i.e., a battery) that sustains the system away from equilibrium. In the 
long time limit, fd = but e p = Qhk = hd > 0. The entropy production rate e p characterizes 
total irreversibility: It has two distinctly different origins: The system's spontaneous relaxation 
(organization) fd and the external environmental drive Qhk ll28ll . 

This theory has only been presented in an applied mathematics style. Further theoretical math- 
ematic analysis is necessary on the subject, as well as applications using this structure to gain fur- 
ther understanding of the stochastic dynamics. In addition, issues such as "principle of maximal 
entropy production" and related issues have never been seriously investigated with mathematical 
rigor, even though they are actively discussed in applied fields such as climate science and ecology 
EHUD El, as well as in high-profile headlines ED. 



5 Investigation and Characterization of Complex Systems and 
Their Dynamics in terms of Nonlinear, Stochastic Models 

The Sees. 3 and 4 set up the fundamental mathematics for studying complex, open systems dy- 
namics. This approach has shown great promises and has provided some powerful novel ideas, as 
well as deeper understanding of the open chemical systems. Whether this approach can be applied 
to other open systems in biology, in economics, and beyond remains to be investigated. One of 
the particular advantages of chemical systems is the existence of the theory of chemical master 
equation. This is the stochastic generalization of the Law of Mass Action in classical, nonlinear 
chemical kinetics. It is the combination of the stochastic framework above and this particular ver- 
sion of stochastic chemical dynamics that has offered us the insights on open chemical systems 
through concrete mathematical models. 

Applying this line of approach to other systems is essential to extend our understanding of open 
systems, and all the issues interested by this workshop. In the past, this line of research has been 
carried out under different headings. One of them is the area of stochastic resonance (SR). Indeed, 
SR has offered a great deal to our current understanding of the important issues. But one needs to 
broaden the scope: As we have pointed out, "oscillations" in an NESS is are necessity; It should 
not considered as a peculiar type of behavior. 

In an even broader, but speculative direction, it has not been lost on us that the eigenvalues of 
the nonsymmetric diffusion process can be complex. The imaginary part dictates a "wave-like" 
behavior in dynamics, as is well understood from Schrodinger's equation. Consider a scenario in 
which the real parts of the eigenvalues are sufficiently small compared with the imaginary parts. 
Then in a quasi- stationary approximation, the dynamics can be treated as a deterministic wave 
phenomenon [34]. 

6 Development and Education of Stochastics in Applied Math- 
ematics and beyond Brownian Motion 

There is no doubt that the Brownian motion is one of the most important aspects of stochastic 
dynamics in continuous space and time. It offers a complete departure from Newton-Laplace's 
classic view of a "smooth world", and has yielded deep insights in connection to geometry and 
other branches of high mathematics, as recognized by the Fields' medals in 2006. 

Still, by completely focusing on this aspect of stochastic dynamics, our understanding of a 
general stochastic dynamical system, which contains both stochastic and nonlinear deterministic 
elements, is embarrassingly rudimentary. In particular, most mathematics are built around the 
well-studied symmetric Markov processes, which have corresponding self-adjoint linear operators. 

As we have mentioned above, open-systems, when represented in terms of Markov processes, 
are precisely nonsymmetric processes. This is one of the lessons we learned from the open- 
chemical systems theory. The nonsymmetricity can be characterized by a quantity called entropy 
production. For discrete-state Markov processes, the symmetric processes are equivalent to Kol- 
mogorov's cycle condition ll3~5l . Concepts such as the cycle condition and detailed balance had 



all been independently discovered in chemistry: Wegscheider's relation in 1901 [36] and detailed 
balance, by G.N. Lewis, in 1925 1571 . 

Compared to the college education of deterministic mathematics, the stochastic mathematics 
is also embarrassingly behind. Here is an example: Many of my third-year students, while have 
the notion of a random variable X with probability density function fx{x), have never learned, or 
are able to work out, how to compute the distribution of Y = g(X), assuming g is a monotonic 
function! But there is no reason for this: The stochastic mathematics is not intrinsically harder, if 
one only deals with discrete events. In particular, with the power of computing, one should be able 
to teach stochastic thinking to first-year students, in science, engineering, economics, and social 
science. We need to have accessible educational programs. Here I emphasize stochastic thinking 
as a distinctly different kind from the statistical thinking. It is mechanistic driven rather than data 
driven. 

Finally, I would like to state that the stochastic dynamical theory is not an alternative to the 
deterministic one. It is a more complete description of the nature which is capable of representing 
systems with and without fluctuations. 
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